Completely Positive Post-Markovian Master Equation via a Measurement Approach 



^1" 
O 

o 

(N 

■4— > 

o 
O 

00 



(N ' 

> : 
. 
■ 

o ■ 
-xt- : 
o . 
^t- ■ 
o ■ 

^ : 



A. ShabaniW and D.A. Lidar^ 
^Physics Department, University of Toronto, 60 St. George St., 
Toronto, Ontario M5S 1A 7, Canada? 2 ' Chemical Physics Theory Group, 
Chemistry Department, and Center for Quantum Information and Quantum Control, 
University of Toronto, 80 St. George St., Toronto, Ontario M5S 3H6, Canada 

A new post-Markovian quantum master equation is derived, that includes bath memory effects 
via a phenomenologically introduced memory kernel k(t). The derivation uses as a formal tool a 
probabilistic single-shot bath-measurement process performed during the coupled system-bath evo- 
lution. The resulting analytically solvable master equation interpolates between the exact Nakajima- 
Zwanzig equation and the Markovian Lindblad equation. A necessary and sufficient condition for 
complete positivity in terms of properties of k(t) is presented, in addition to a prescription for the 
experimental determination of k(t). The formalism is illustrated with examples. 
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An open quantum system is one that is coupled to an 
external environment 0, Q. Such systems are of fun- 
damental interest, as the notion of a closed system is 
always an idealization and approximation. Open quan- 
tum systems tend to decohere, and for this reason have 
recently received intense consideration in quantum infor- 
mation science, where decoherence is viewed as funda- 
mental obstacle to the construction of quantum informa- 
tion processors It is possible to write down an exact 
dynamical equation for an open system, but the result - 
an integro-differential equation |j] - is mostly of formal 
interest, as such an exact equation can almost never be 
solved analytically or even numerically. In contrast, when 
one makes the Markovian approximation, i.e., when one 
neglects all bath memory effects, the resulting Lindblad 
master equation 0,01 is formally solvable and amenable 
to numerical treatment. Moreover, the desirable prop- 
erty of complete positivity || is maintained (see, how- 
ever, for a debate on the importance of this prop- 
erty) . A coveted goal of the theory of open quantum sys- 
tems 0,0 is a "post-Markovian" master equation that (i) 
generalizes the Markovian Lindblad equation so as to in- 
clude bath memory effects, at the same time (ii) remains 
both analytically and numerically tractable, and (in) re- 
tains complete positivity. A variety of post-Markovian 
master equations have been proposed and analyzed, e.g., 
0I1I1EII1HHQEG]!- However, one of the 
desirable properties (i)-(iii) above is typically lost: e.g., 
in the case of time-convolutionless master equations (e.g., 
|lfj|) one may lose complete positivity, while in the case 
of nonlocal stochastic Schrodinger equations (e.g., |l3jl 
one loses analytical solvability. In this work we propose 
a new post-Markovian master equation that satisfies all 
of the desirable properties (i)-(iii) above. The key idea 
we introduce is an interpolation between the generalized 
measurement interpretation of the exact Kraus operator 
sum map [fj, and the continuous measurement interpre- 
tation of Markovian-limit dynamics [lH [iH ] . 



system dynamics. — Consider a quantum system S cou- 
pled to a bath B (with respective Hilbert spaces Hs, Hb), 
evolving unitarily under the total system-bath Hamilto- 
nian Hs b ■ The exact system dynamics is given by tracing 
over the bath degrees of freedom 0, 0, Q 



P (t) =Tr B [U(t)ps B (0)U\t)}, 



(1) 



where p(t) is the system state, pss(O) = p(0) ® ps(0) is 
the initially uncorrelated system-bath state, and U(t) = 
Texp(— i J Q HsB(t')dt') (T denotes time-ordering; we set 
h = 1 and for simplicity work in the interaction picture 
with respect to both system and bath). Eq. Q can be 
rewritten in terms of an operator sum (the Kraus repre- 
sentation 0) 



p(*)=E4(*Mo)A fc (f), 



(2) 



Review of quantum measurements approach to open 



where Tr\p(t)] = 1 «■ £ fc A k {t)A\(t) = I. 

Let us now recall how to derive the exact Eq. from 
a measurement picture [Fig.^i]. Imagine the bath acting 
as a probe coupled to the system at t = 0, with the inter- 
action given by Hsb as above. To study the state of the 
system a single projective measurement is performed on 
the bath at time i, with a complete set of projection op- 
erators H B = Span{|i)}. The measurement yields 
the result k and collapses the state of the bath to the 
corresponding eigenstate \k). This happens with proba- 
bility pk — Trs[(k\psB(t)\k)], and the system density ma- 
trix reduces to p k (t) = (k\p SB {t)\k) /p k =: A\p(0)A k /p k , 
where A k are the Kraus operators. If we repeat this 
process for an identical ensemble initially prepared in 
state pss(0) the average system density matrix becomes 
P(t) = E k PkP k (t) = Tv B [U(t)p SB (0)W(t)}, which is 
just Eq. QJ, thus affirming the validity of this bath- 
measurement interpretation of open system dynamics. 
The corresponding map $ is completely positive (CP) 
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FIG. 1: Measurement approach to open system dynamics. 
P=preparation, M= measurement, time proceeds from left to 
right, a) Exact Kraus operator sum representation, b) Marko- 
vian approximation, c) Single-shot measurement, d) Single- 
shot measurement followed by Markovian dynamics. 



In contrast, in the Markovian limit the most general 
CP system dynamics is given in the interaction picture 
by the Lindblad equation [j| 



% = C P := -lj2a a ([F a)P F& + [F a p,F%\). 



(3) 



The Lindblad operators F a 's are bounded operators act- 
ing on 7^5 , and the a a > are constants that describe de- 
coherence rates. Now let us recall how also the Lindblad 
equation can be given a measurement interpretation. Ex- 
panding Eq. @ to hrst order in the short time interval r 
yields p(t + r) = (I- § £ Q F^ a F a )p(t)(I- § £ Q FtF a ) + 
r £ Q F a p(t)F^. To the same order we also have the nor- 
malization condition (I- § J2 a F ] a F a ){I- § £ Q F^F a ) + 
r^2 a F^F a = I. Thus the Lindblad equation has been 
recast as a Kraus operator sum , but only to first order 
in r, the coarse-graining time scale for which the Marko- 
vian approximation is valid 19(. Clearly, then, we again 
have a measurement interpretation, wherein as before the 
bath functions as a probe coupled to the system while be- 
ing subjected to a continuous series of measurements at 
each infinitesimal time interval r [Fig. Hb)]. This is the 
well-known quantum jump process [18j, wherein the mea- 
surement operators are I— ^ £ « FgFp (the "conditional" 
evolution) and y/rF a (the "jump"). 

We have thus seen how a measurement picture leads 
to the two limits of exact dynamics (via an evolution of 
the coupled system-bath followed by a single generalized 
measurement at time t), and Markovian dynamics (via 
a series of measurements interrupting the joint evolution 
after each time interval r). With this in mind it is now 
easy to see that by relaxing the many-measurements pro- 
cess one is led to a less restricted approximation than the 
Markovian one. Here we use this observation to derive a 
post-Markovian master equation based on a probabilistic 
single-shot measurement process. 

Derivation of a post-Markovian master equation. — 
The first stage of exerting an approximation on the ex- 
act Eq. (JJJ should be to include one extra measurement 
in the time interval [0, t]. Thus we consider the following 
process: a probe (bath) is coupled to the system at t = 0, 
they evolve jointly for a time t' (0 < t' < t) such that 



at t' the system state is A(i')p(0), where A(t') is a one- 
parameter map, at which moment the extra generalized 
measurement is performed on the bath. A does not de- 
pend on t since the bath resets upon measurement. Sys- 
tem and bath continue their coupled evolution between 
t' and t, upon which the final measurement is applied. 
This is illustrated in Fig. Since this intermediate 
measurement determines the system state \ip) at t', after 
time t — t' the system state will be p{t) = A(t — t')p(t'). 
It is important to stress that pit') cannot be written as 
A(t')p(0), since the measurement selects p(t') at random. 

The time t' characterizes bath memory effects and 
must be determined as a function of time-scales char- 
acterizing the evolution. We do this by introducing 
a bath memory function (kernel) k(t — t',t) that as- 
signs weights to different measurements. To derive a 
master equation we discretize the time interval [0, t] 
into N equal segments of length e, and express t — 
Ne, t' = me. We then have the weighted average 
p{t = Ne) = J2m=i H(N-m)e, Ne)A((N -m)e)p(me) = 
Sm=i M me i Ne)A(me)p((N — m)e). From hereon we as- 
sume that A is trace-preserving, whence k must be nor- 
malized so that Yl m =i k{me, Ne) = 1 (k(f, t) = for 
t' £ [0, i]), though an exception to this will arise below. 
We then have (for N > 1) 



N-l 

p(Ne) - p((N - l)e) = ^ k{me, (N - l)e)A(me) > 

m— 1 

N-l 

[p((N - m)e) - p((N - to - l)e)] + ^ [ fc ( me > Ne ) 

m—1 

-k(me, (N - l)e)]A(me)p((N - m)e) 
+k(Ne,Ne)A(Ne)p(0). 



(4) 



In order to arrive at a differential equation the term 
proportional to A(Ne)p(0) must be made to van- 
ish. We therefore impose the additional constraint 
\im € ^o k(Ne : Ne)/e = 0. Taking the limits e -> 0, 
to, N — > oo such that me — t' and Ne = t, we con- 
vert the remaining terms in Eq. Q into differential form 
by expressing [p((N — m)e) — p({N — 1 — m)e)]/e — > 
and [k(me, Ne) - k(me, (N - l)e)]/e -> 

Eq. @ then yields: §f = f* dt'[k(t', t)A(t') + 

dk ^ t '^ A(t')p(t — t')]. We would like to arrive at a proper 
integro-differential equation involving, on the right-hand- 
side (RHS), only p and not its derivative. We thus 
assume, only in the derivative of p on the RHS, that 
p(t—t') — A(t—t')p(0). Such an assumption is equivalent 
to the standard procedure of first-order time-dependent 
perturbation theory, and can, analogously, be iterated 
self-consistently to obtain higher-order approximations. 
Expressing p(0) = A~ x (t — t')p(t — t') we then obtain the 
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post-Markovian dynamical equation 



left eigenvectors {Ri},{Li} that fulfill the orthonormal- 



dp 

dt 



dt'[k(t')A(t')A(t - t')A-\t - t') 



dk(t',t) 
dt~ 



A(t')]p(t-n 



(5) 



This new, formal master equation is the first main re- 
sult of this work. Note that in this integral form the 
constraint lim e ^ k(Ne, Ne)/e = can be lifted, as it 
cannot change the value of the integral. 

To make further progress we now assume a Markovian 
form for the superoperator: A(t) — exp(Ct). Here L can 
be interpreted as the Lindblad generator [Eq. {jJJ] . Using 
this in Eq. © yields 



dk(t',t) . 

dt 



exp(Ct')p(t-t'). (6) 



This master equation is rather interesting and appears 
amenable to analytical treatment, an undertaking which 
will be the subject of a future study. To make even 
further progress, let us note that Eq. 10 automatically 
preserves Trp, even without requiring normalization of k 
via f k{t',t)dt' = 1. Since the latter was needed above 
to ensure trace preservation, it can now be dropped. 
This allows us to consider memory kernels satisfying 
k(t',t) = k{t'). We thus arrive at our second main re- 
sult: 

^ = C [ dt'k(t') exp{£t')p(t-t') = Lk{t) exp(£t)*p(t), 

(7) 

where * denotes convolution and k no longer obeys any 
constraints. 

Henceforth we confine our attention for simplicity and 
cxplicitness to the new post-Markovian master equa- 
tion (0, though some of the results below are general- 
izable to Eq. JSJ. While k is still unspecified, we show 
below that it can be determined by an appropriate quan- 
tum state tomography experiment. As we further show 
below, Eq. J7J satisfies all the conditions we stated in 
the introduction for a "desirable" post-Markovian mas- 
ter equation. Finally, note that Eq. reduces to a 
purely Markovian master equation, dp/dt = Cp(t), when 
k(t') ~ 8(t'), as expected for a memoriless channel. 

Dynamical map. — We now analytically derive the dy- 
namical map : p(0) i— ► p(t) governing our master 
equation. We solve the integro-differential equation Q 
by taking the Laplace transform: 



sp(s) - p(0) = [k(s) * 



C 



C 



(8) 



where X(s) := Lap[X(t)] is the Laplace transform of 
the function X(t). Now consider the solution of the 
eigenvalue equation Cp = Xp. It results in a set of 
(complex) eigenvalues {A^} and corresponding right and 



ity condition Tr[LiRj 



These eigenvectors are 



known as the damping basis |20j of the superopera- 
tor C. Expressing the density matrix in this basis as 
pit) = Y,i Tf[^»p(*)]-Ri = X^M»(f)iii and taking the 
Laplace transform, allows us to use Eq. (JSJ to solve for 
the expansion functions Pi(t): spi(s) — Pi(0) — A^fc(s — 
Ai)Mi(s) => 



Pi(t) = Lap : [- 



1 



A 4 fc(s - Aj) 



]^(0) =: &(i)Mi(0). (9) 



The functions can now be computed using the 

residue theorem formula applied to the Bromwich in- 
tegral formula for the inverse Laplace transform: if 
f(s) = LapLF(t)] then F(t) = £ Pfc Res[e st /(s),M 
where pu are the poles of e st f(s) and Res[g,p] := 

(^T)T (iP^r t( s ~ P)" 9 ^) is the residue of 9, with 

n the order of the pole p. In our case f(s) = [s — Xik(s — 
Ai)] _1 and so the poles pk are determined by the solu- 
tions of the equation s — A^fc(s — Ai) for s. This equa- 
tion can be solved once the Lindblad generator C (yield- 
ing the Aj) and the memory kernel k(t) are specified. 
Then £j(t) = J2 (0 R- es [ eS */( s ))Pfe ]• Summarizing, the 
dynamical map corresponding to Eq. JJJ is 



(10) 



Using the orthonormality of the damping basis it follows 
that : Y h-> £\ 6 (i) -1 Tr[Z, i Y].fl i . Thus $ is in- 

vertible with the exception of the points where £,*(t) = 0. 
For contractive (e.g., Markovian) maps this will happen 
at t = oo, though in general additional points cannot be 
excluded. 

Condition for complete positivity of 4>. — Let us recall 
Choi's theorem [2l|: "Let W : GL(n;C) i-> GL(m;C) 
be a linear map. Then \P is CP iff the matrix whose 
elements are {^[Eij]}i<ij< n is positive, where Eij is 



a matrix with (£V 



1 and all other elements 



zero." Using Choi's theorem |21| the criterion for com- 
plete positivity of our map is equivalent to positiv- 
ity of the matrix P whose (i,j)th element is 
Namely, P > «■ {E fc ffc(*)^[^fcl*>01]^fc}i<iJ<n - 
{^2k^k(t)(j\Lk\i)Rk}i<i,j<n > 0, which, in turn, is 
equivalent to: 



(11) 



The inequality (|llf) is a necessary and sufficient condition 
for our map to be CP. Because the functions are 
given in terms of the memory kernel k{t) through Eq. JjJJl, 
this inequality results in a condition on k(t), which can 
be checked in order to verify that a given such kernel 
results in a CP map. Further note that Eq. Q preserves 
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the trace of p(t) [i.e., d Tr p(t)/dt = 0], as is evident from 
Tr£ = and a Taylor expansion of exp(£i). 

Kraus representation of — Since the matrix P is 
positive it can be expressed as P = J^k l a fc)( a fe| where the 
|etfc)'s are the eigenvectors of P. One can divide the vector 
|dfc) into n segments of length n, where n = dim[Wg], and 
define a matrix M/. with the zth column being the ith seg- 
ment of |afc), so that the ith segment is Mfe|i). Then the 
dynamical map is reconstructed as £{p) = MapM^, 
which is the desired Kraus representation. 

Connection to other master equations. — We first note 
that our master equation J7J is an instance of the exact 
Nakajima-Zwanzig (NZ) equation p = J Q dt'0(t,t')p(t') 
Q, where the NZ kernel 0(t,t') is, in our case, of the 
special time translationally- invariant form 0(t' — t). Sec- 
ondly, in the particular case that ||£|| <C l/t Eq. (J7J) 
reduces to 



dp 
dt 



C / dt'k(t')p(t-t'). 



(12) 



This master equation was proposed intuitively in 
Ref. 0], where it was studied in the case of a damped 
harmonic oscillator and it was shown to lead, under cer- 
tain assumptions, to unphysical behavior. This issue was 
clarified in the recent work , where it was shown that 
a single qubit subject to telegraph noise can be described 
by Eq. 1(12(1 . and where conditions for complete positiv- 
ity of l |l 2(1 were established; our inequality 1 (11(1 includes 
this as a special case. Thirdly, we can rewrite Eq. (J7J) 
in time-convolutionless form using the backward prop- 
agator method ||: Using Eq. ((THf we can express the 
formal solution of Eq. Q as p{t) = &(t)p(0). We have 
already discussed above the invertibility of $(t); assum- 
ing <i>~ 1 exists Eq. @ can then be rewritten in time- 
convolutionless form as 



dp 

dt 



C I k(t')exp(£t')<P{t 
o 



t')dt'$ -1 (*) 



p(t), (13) 



with the operator in square brackets serving as the gen- 
erator of the evolution. 

Experimental determination of the kernel function. — 
Suppose one measures p(t) via quantum state tomog- 
raphy (QST) 3]. It then follows from Eq. ap- 
plied to pit) that &(*) = Tr[Lip(t)]/Tr[Lip(Q)]. The 
coefficients £j (t) are thus directly experimentally accessi- 
ble, provided one first specifies a Markovian model from 
which the left eigenvectors Li and eigenvalues Xi can be 
computed. Inverting Eq. then yields the kernel as 
k(t) = Lap _1 [(s- 1/Lap[^(t)])]e- A **/A i . This inversion 
process for k(t) is not unique in the sense that it will de- 
pend on the choice of Markovian model. It can be opti- 
mized via well-established maximum likelihood methods, 
e.g., , thus yielding the optimal Markovian model. 

Example. — As a concrete example meant to illustrate 
the predictions of our master equation we consider the 



problem of a single qubit dephasing. The Lindblad su- 
peroperator is Cp = — (a/2)[cr Z) [a z , p]], a > 0. Us- 
ing the parametrization p(t) = (I + a(t) ■ <?)/2 [with 
a G M 3 and a — (a x , a y , cr z )], the damping basis is 
found to consist of the following eigenvalues and eigen- 
operators: { A, }f =0 = {0, —a, —a, 0}, and {Ri}f =0 — 
{Li}? =0 = {7, a x , o-y, cr 2 }/v / 2. The Markovian solution 
is simple exponential coherence decay: a z (t) — 1 and 
atj(t) = ccj(0) exp(— at), j — x,y. It follows immediately 
from Eq. © that £ (*) = = Lap^l^s] = 1 and 

that £ x {t) = C y {t) =: f{t). We further find {a>j(t) = 
£j{t)}j=x,y,z- Applying the criterion ((11(1 readily yields 
the CP condition as \f(t)\ < 1. Let us consider two 
kernel functions: ki(t) — Aexp(— jt) fei(s) = 



i(pt)} =>■ k 2 (s) = 



and k 2 (t) = Ae-^- a ^[cos(pt) 

( s -a+7)°+^i 2 • Then, following the prescription of Eq. @ 
yields f\{t) = exp[— t(a + 7)/2][cos(wt) + sin(u;t)(a + 
y)/2u] where lo = yjAAa - (j + a) 2 /2, and f 2 (t) = 1 - 
[1 - e~ 7 * (cos nt + £ sin tit)] where ft = ^p 2 + Aa 
(note that the CP condition |/i,2(i)| < 1 imposes re- 
strictions on the allowed values of the various parame- 
ters appearing here) . In both cases we thus find damped 
oscillations. The difference is that in the case of ki we 
have /i(oo) = 0, as in the Markovian case, while in the 



case of k 2 we have f 2 (oo) = 1 



Aa 



which cannot 



be mimicked by the Markovian solution. Damped oscil- 
lations with a non-zero asymptotic coherence, as in the 
case of k 2 , are a feature of the exact solution of a single 
qubit dephasing in the presence of a boson bath, e.g., 
when a peaked spectral density g{u>) oc exp[— c(lj — u>o) 2 ] 
is chosen [J^. We thus see explicitly through the exam- 
ple considered here, how our new master equation (JZJ) 
is capable of interpolating between exact and Markovian 
open system dynamics. 
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